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Delay Bounds for Networks with Heavy-Tailed 

and Self-Similar Traffic 

Jorg Liebeherr, Almut Burchard, Florin Ciucu 
Abstract 

We provide upper bounds on the end-to-end backlog and delay in a network with heavy-tailed and self-similar 
traffic. The analysis follows a network calculus approach where traffic is characterized by envelope functions and 
service is described by service curves. A key contribution of this paper is the derivation of a probabilistic sample path 
bound for heavy-tailed self-similar arrival processes, which is enabled by a suitable envelope characterization, referred 
to as htss envelope. We derive a heavy-tailed service curve for an entire network path when the service at each node 
on the path is characterized by heavy-tailed service curves. We obtain backlog and delay bounds for traffic that is 
characterized by an htss envelope and receives service given by a heavy-tailed service curve. The derived performance 
bounds are non-asymptotic in that they do not assume a steady-state, large buffer, or many sources regime. We also 
explore the scale of growth of delays as a function of the length of the path. The appendix contains an analysis for 
self-similar traffic with a Gaussian tail distribution. 



I. Introduction 

Traffic measurements in the 1990s provided evidence of self-similarity in aggregate network traffic (22J, 
and heavy-tailed files sizes and bursts were found to be among the root causes fl2~) , [34]. Since such traffic 
induces backlog and delay distributions whose tails decay slower than exponential, the applicability of 
analytical techniques based on Poisson or Markovian traffic models in network engineering has been called 
into question [30], thus creating a need for new approaches to teletraffic theory. 

A random process X is said to have a heavy-tailed distribution if its tail distribution is governed by a 
power-law Pr(X(t) > x) ~ Kx~ a , with a tail index a G (0,2) and a scaling constant We will 
consider tail indices in the range 1 < a < 2, where the distribution has a finite mean, but infinite variance. 
A random process X is said to be self-similar if a properly rescaled version of the process has the same 
distribution as the original process. We can write this as X(t) ^dist a~ H X(at) for every a > 0. The 
exponent H £ (0, 1), referred to as the Hurst parameter, specifies the degree of self-similarity]^] We refer to 
a process as heavy-tailed self-similar if it satisfies both criteria. 

A performance analysis of networks with heavy-tailed self-similar traffic or service, where no higher 
moments are available, is notoriously hard, especially an analysis of a network path across multiple nodes. 
Single node queueing systems with heavy-tailed processes have been studied extensively (7J, (23J, [29|. 



However, there exist only few works that can be applied to analyze multi-node paths. These works generally 
consider an asymptotic regime with large buffers, many sources, or in the steady state. Tail asymptotics for 
multi-node networks have been derived for various topologies, such as feedforward networks p7) , cyclic 
networks [2], tandem networks with identical service times (6j, and tandem networks where packets have 
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^e write f(x) ~ g(x), if lim^oo f(x)/g(x) = 1. 

2 The networking literature frequently uses the weaker concept of second-order self-similarity. Since we will work with heavy- 
tailed distributions, for which higher moments are not available, we use the more general definition of self-similarity. 
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independent service times at nodes in the more general context of stochastic event graphs |3p. The accu- 
racy of some asymptotic approximations has been called into question, particularly, the quality of large 
buffer asymptotics for heavy-tailed service distributions was found to be lacking in [1], thus motivating a 
performance analysis in a non-asymptotic regime. 

This paper presents a non-asymptotic delay analysis for multi-node networks with heavy-tailed self- 
similar traffic and heavy-tailed service. We derive the bounds for a flow or flow aggregate that traverses 
a network path and experiences cross traffic from heavy-tailed self-similar traffic at each node. Both fluid 
and packetized interpretations of service are supported; in the latter case, we assume that a packet maintains 
the same size at each traversed node. A key contribution of this paper is a probabilistic sample path bound 
for heavy-tailed self-similar arrival processes. The derivation of the sample path bound is made possible 
by a suitable envelope characterization for heavy-tailed self-similar traffic, referred to as htss envelope. We 
present a characterization for heavy-tailed service and show that it can express end-to-end service available 
on a path as a composition of the heavy-tailed service at each node. Our end-to-end service characterization 
enables the computation of end-to-end delay bounds using our single-node result. In an asymptotic regime, 
our bounds follow (up to a logarithmic correction) the same power law tail decay as asymptotic results that 
exist in the literature for single nodes. Finally, we show that end-to-end delays of heavy-tailed traffic and 
service grow polynomially with the number of nodes. For example, for a Pareto traffic source with tail index 

ct + l 1 

a we find that end-to-end delays are bounded by 0(N a - 1 (log N) ) in the number of nodes N. 

Our analysis follows a network calculus approach where traffic is characterized in terms of envelope 
functions, which specify upper bounds on traffic over time intervals, and service is characterized by service 
curves, which provide lower bounds on the service available to a flow [5 ]. An attractive feature of the net- 
work calculus is that the service available on a path can be composed from service characterizations for each 
node of the path. We consider a probabilistic setting that permits performance metrics to be violated with a 
small probability. Probabilistic extensions of the network calculus are available for traffic with exponential 
tail distributions (9), distributions that decay faster than any polynomial (32j, and traffic distributions with 
an effective bandwidth [9]. The latter two groups include certain self-similar processes, in particular, those 



governed by fractional Brownian motion [28 1, but do not extend to heavy-tailed distributions. There are 



also efforts for extending the network calculus to heavy-tailed distributions [14], [ 15 1, 1 18 1, 1 19 1, which are 
discussed in more detail in the next section. 

The remainder of this paper is organized as follows. In Section ITT] and SectionlTTl] respectively, we discuss 



our characterization of heavy-tailed traffic and service by appropriate probabilistic bounds. In Section IV 
we present our main results: (1) a sample path envelope for heavy-tailed self-similar traffic, (2) probabilistic 
bounds for delay and backlog, (3) a description of the leftover capacity at a constant-rate link with heavy- 
tailed self-similar cross traffic, and (4) a composition result for service descriptions at multiple nodes. In 
Section[V]we discuss the scaling properties of the derived delay bounds in terms of power laws. We present 
brief conclusions in Section IVT1 

II. The htss Traffic Envelope 

In this section we present and evaluate a probabilistic envelope function, for characterizing heavy-tailed 
self-similar network traffic that permits the derivation of rigorous backlog and delay bounds. The proposed 



htss envelope further develops concepts that were previously studied in [ 15 ], [ 18 ], [ 19]. 

We consider arrivals and departure of traffic at a system, which represents a single node or a sequence 
of multiple nodes. We use a continuous time model where arrivals and departures of a traffic flow at the 
system for a time interval [0,i) are represented by left-continuous processes A(t) and D(t), respectively. 
The arrivals in the time interval [s, t) are denoted by a bivariate process A(s, t) := A(t) — A(s). Backlog 
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and delay at a node are represented by B(t) = A(t) - D(t) and W(t) = inf {d : A(t - d) < D(t)}, 
respectively. When A and D are plotted as functions of time, B and W are the vertical and horizontal 
distance, respectively, between these functions. 

A statistical envelope Q for an arrival process A is a non-random function which bounds arrivals over a 
time interval such that, for all s, t > and for all a > fTO): 



Pr(A(s,t) >G{t-s;a)^ < e{a) , (1) 

where e is a non-increasing function of a that satisfies e(a) — ► as a — » oo. The function e{a) is used 
as a bound on the violation probability. Statistical envelopes have been developed for many different traffic 
types, including regulated, Markov modulated On-Off, and Gaussian self-similar traffic. A recent survey 
provides an overview of envelope concepts (24). 

The computation of performance bounds, e.g., bounds on backlog delay, and output burstiness, requires a 
statistical envelope that bounds an entire sample path {A(s, t)} s<t . A statistical sample path envelope Q is 
a statistical envelope that satisfies for all i > and for all a > |T0) : 



Pr(sup{vl(s,i) -a(i-s;<x)} > o) <e(tr) . (2) 

Clearly, a statistical sample path envelope is also a statistical envelope, but not vice versa. In fact, only 
few statistical envelopes (in the sense of Eq. ([I])) lend themselves easily to the development of sample 
path envelopes (as in Eq. Q). One of the earliest such envelopes appears in the Exponentially Bounded 
Burstiness (EBB) model from J35| , which requires that Pr(A(s,t) > r(t — s) + a) < Me~ a<T , for some 
constants M, r and a and for all a > 0. If r corresponds to the mean rate of traffic, an EBB envelope 
specifies that the deviation of the traffic flow from its mean rate has an exponential decay. A sample path 
bound for EBB envelopes in the sense of Eq. §2§ is obtained via the union bound^Jby evaluating the right- 
hand side of Eq. Q as Y^k P r {A{sk,t) > G(t — Sk-i; <r)) for a suitable discretization {sk}k=i,2,..., yielding 
Q(t — s;a) = Rt + a for R > r and e(a) = 1 _^ /e a( ^,1 r) [10]. The EBB envelope has been generalized to 
distributions with moments of all orders, referred to as Stochastically Bounded Burstiness (SBB) [32] and 
corresponding sample path bounds have been developed in (361. SBB envelopes can characterize arrival 
processes that are self-similar, but not heavy-tailed. For instance, fractional Brownian motion processes can 
be fitted with an envelope function Q(t) = rt + a with a Weibullian bound on the violation probability of 
the form e(a) = Ke~^^" for some a > and < b < 1. 

A statistical envelope for general self-similar arrival processes can be expressed as 

Pr (A(s, t) > r{t -s) + <r{t ~s) H ^j < e{a) . (3) 

Note that A(s, t) —r(t — s) <dist X(t — s), where X is a process satisfying the self-similar property given in 
the introduction. For self-similar traffic, it is natural to allow a heavy-tailed violation probability, since self- 
similarity can arise from heavy-tailed arrival processes with independent increments^] This consideration 
leads to our proposed extension of the EBB and SBB concepts that capture characteristics of heavy-tailed 
and self-similar traffic. We define a heavy-tail self-similar (htss) envelope as a bound that satisfies for all 
a > that 

Pr(A(s, t) > r(t -s)+ a(t - s) H ) < Ka~ a . (4) 



3 For two events X and Y, Pr(X U Y) < Pr(X) + Pr(Y). 

4 This is evident in Eqs. l|l3|-(|l4| below in an application of the Generalized Central Limit Theorem for a Pareto traffic source. 
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where K and r are constants, and H and a, respectively, indicate the Hurst parameter and the tail index. We 
generally assume that a G (1, 2), that is, arrivals have a finite mean but infinite variance, and H G (0, 1). In 
the htss envelope the probability of deviating from the average rate r follows a power law. Moreover, due 
to self-similarity, these deviations may increase as a function of time. Since the htss envelope specifies a 
bound, it can be used to describe any type of traffic, but the characterizations will be loose unless the traffic 
has some heavy-tailed self-similar properties. In terms of Eq. ([I]), the htss envelope is a statistical envelope 
with 

g(t; a)=rt + at H , e(a) = Ka' a (5) 



In Section [TV] we will derive a sample path envelope for the htss envelope, which is necessary for the 
computation of probabilistic upper bounds on backlog and delay of heavy-tailed self-similar traffic at a 
network node. 

Characterizations of self-similar and heavy-tailed traffic by envelopes have been presented before, gener- 
ally, by exploiting specific properties of a- stable processes p4| , 1 19 1. An envelope for a- stable processes in 



|15[ takes the same form Q(t; a) = rt + at H as the htss envelope, but specifies a fixed violation probability 
rather than a bound on the distribution. An issue with such a characterization is that it does not easily lead to 



sample path envelopes. For H = 0, a sample path version of Eq. Q has been obtained in [ 18 ] by applying 
an a-priori bound on the backlog process of an a-stable self-similar process from fT9j . Since the backlog 
bound given in Eq. (24) of [fl9| is a lower bound (and not an upper bound) on the tail distribution of the 



buffer occupancy, the envelope in fT8| does not satisfy Eq. (|2j). In Section IV it will become evident that 



sample path envelopes for arrivals and backlog bounds are interchangeable, in that the availability of one can 
be used to derive the other. Thus, the sample path bound derived in this paper for heavy-tailed self-similar 
processes satisfying the htss envelope from Eq. Q also provides the first rigorous backlog bounds for this 
general class of processes. 



In the remainder of this section, we show how to construct htss envelopes for relevant distributions, as 
well as for measurements of packet traces. Ever since traffic measurements at Bellcore from the late 1980s 
discovered long-range dependence and self-similarity in aggregate network traffic |22| , many studies have 
supported, refined, sometimes also repudiated (e.g., fl6fl ) these findings. This report does not participate in 
the debate whether aggregate network traffic is best characterized as short-range or long-range dependent, 
self-similar or multi-fractal, short-tailed or heavy-tailed, and so on. Rather we wish to provide tools for 
evaluating the performance of networks that may see heavy-tailed self-similar traffic, and shed light on the 
opportunities and pitfalls of envelope descriptions for heavy-tailed traffic. 

A. a-stable Distribution 

Stable distributions provide well-established models for non-Gaussian processes with infinite variance. 
The potential of applying stable processes to data networking was demonstrated in jT9| by fitting traces of 
aggregate traffic (i.e., the Bellcore traces studied in [22j) to an a-stable self-similar process. 

A defining property of an a-stable distribution (0 < a < 2) is that the linear superposition of i.i.d. 
a-stable random variables preserves the original distribution. That is, if X\ , X2 , ■ ■ . X m are independent 
random variables with the same (centered) a-stable distribution, then mT x l a YUlLi %i nas me same distribu- 
tion. A challenge of working with a-stable distributions is that closed-form expressions for the distribution 
are only available for a few special cases. However, there exists an explicit expression for the characteristic 
function of stable distributions, in terms of four parameters (see plj]): a tail index a G (0, 2], a skewness 
parameter f3 G [—1, 1], a scale parameter a > 0, and a location parameter [i G M. For our purposes it is 
sufficient to work with a normalized stable random variable S a where /3 = 1, a = 1, and \x = 0. 
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The point of departure for our characterization of a-stable processes with htss envelopes is the a-stable 
process proposed in fT9j which takes the form 

A(t) di = rt + bt H S a . (6) 
Here, r is the mean arrival rate and 6 is a parameter that describes the dispersion around the mean. 

Remark: We can use Eq. Q to observe the statistical multiplexing gain of a-stable processes. By the 
defining property of S a , the superposition of N i.i.d. processes as in Eq. (|6]), denoted by A mux , yields 

A mU x(t) = Nrt + N l ' a bt H S a . 

Since 1/a < 1 in the considered range a £ (1,2), the aggregate of a set of flows increases slower than 
linearly in the number of flows, thus, giving clear evidence of multiplexing gain. The multiplexing gain 
diminishes as a — > 1. 

We can obtain an htss envelope for Eq. (|6]) from the tail approximation for a-stable distributions 1 27 1 

Pr(s a > cr) ~ (c Q a)' a , a oo , (7) 

where c a = ^ 2r ( a )^ m 2 ^ a anc j j s ^ e Q amma function. With Eq. (6 1 we can write 

_ (A{t)-rt \ 

Fr [ ZTff > cr I ~ [C a cr) , cr ->• 00 , 

Matching this expression with Eq. ([4]) we obtain the remaining parameter K of the htss envelope by setting 

*-(£)"• 

By Eq. (|7]), this envelope only holds for large a, or, equivalently, low violation probabilities. An alternative 
method to obtain an htss envelope for all values of a is to take advantage of the quantiles of S a . Since the 
density of S a is not available in a closed form, the quantiles must be obtained numerically or by a table 
lookup. Let the quantile z(e) be the value satisfying 

P{S a > z{e)) =e. (9) 

We obtain a statistical envelope by setting Q (t; a) =rt+ z(e)at H with a fixed e. In fact, this is the envelope 
for a-stable processes from 1 15]. However, since z{e) does not follow a power law, it is not an htss envelope. 
To obtain an htss envelope from the quantiles, we express Eq. ([4]) in terms of Eq. Q, which can be done by 
setting 

K = sup {e ■ {bz{e)) a } . (10) 

0<e<l 

In Fig. [T] we present envelopes for a process satisfying Eq. (|6]> with 

r = 75Mbps, a = 1.6, H = 0.8, b = 60 Mbps . 

We show statistical envelopes with fixed violation probabilities e = 10 _1 , 10 -2 , 10~ 3 . The graph compares 
the htss envelopes constructed with the tail approximation using Eq. (|7]) to those obtained from the quantiles 
via Eq. ( 10 1. As can be expected, the envelopes computed from the asymptotic tail approximation are smaller 
than the quantile envelopes. We add that envelopes computed from the quantiles for a fixed e, as described in 
Eq. (|9]), are very close to the tail approximation envelopes. If the corresponding envelopes were included in 
the figure, they would appear almost indistinguishable, suggesting that Eq. (|7]) provides reasonable bounds 
for all values of a. 
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B. Pareto Packet Distribution 

As second case study, we present an htss envelope construction for a packet source with a Pareto arrival 
distribution. Packets arrive evenly spaced at rate A and packet sizes are i.i.d. described by a Pareto random 
variable Xi for the i-th packet with tail distribution 



Pr 



(x i>X ) = (|) a , x>b, (11) 



where a G (1,2). X has finite mean E[X] = M L and infinite variance. We will construct an htss envelope 
for the compound arrival process 

N(t) 

A(t) = J2 x i, (12) 
i=i 

where N(t) = [Xt\ denotes the number of packets which arrive by time t. This arrival process is asymptot- 
ically self-similar with a Hurst parameter of H = 1/a. 

For the htss envelope construction of the Pareto source, we take advantage of the generalized central limit 
theorem (GCLT) [27) 1, which states that the a-stable distribution S a appears as the limit of normalized sums 
of i.i.d. random variables. For the independent Pareto random variables Xi, the GCLT yields 



T.UX i -nE l X ]n ^ Sa (13) 



in distribution. Since the GCLT is an asymptotic limit, envelopes derived with the GCLT are approximate, 
with higher accuracy for larger values of n. Using that N(t) Xt for suitable large values, we can write the 



arrival function in Eq. ( |T2| ) with Eq. ( [13] ) as 

A{t) « XtE[X] +c a {Xt) 1/a S a 
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Since this expression takes the same form as Eq. Q, we can now use the tail estimate of Eq. (|7]) to obtain 
an htss envelope with parameters 

r = XE[X], a, H=-, K « A . (14) 
a 

The same parameters are valid when N{t) is a Poisson process, according to Theorem 3.1 in [21]. 

Similar techniques can yield htss envelopes for other heavy-tailed processes. For example, an aggregation 
of independent On-Off periods, where the duration of 'On' and 'Off periods is governed by independent 
Pareto random variables yields an a-stable process J26j in the limit of many flows (N — ► oo) and large time 
scales (t — ► oo). This aggregate process is particularly interesting since dependent on the order in which 
the limits of N and t are taken, one obtains processes that are self-similar, but not heavy-tailed (fractional 
Brownian motion), processes that are heavy-tailed, but not self-similar (a-stable Levy motion), or a general 
a-stable process. An approximation by an a-stable process followed by an estimation of htss parameters 
can also be reproduced for the M/G/oo arrival model [26]. 

Example. We next compare envelope constructions for a Pareto source with evenly spaced packet arrivals 
with a size distribution given by Eq. ( [TTj ). The parameters are 

a = 1.6, b =150 Byte, A = 75 Mbps. 

With these values, the average packet size is 400 Byte. We evaluate the following types of envelopes: 

1. htss GCLT envelope. This refers to the envelope constructed with the GCLT according to Eq. ( p"4"| ). The 
value of a of the htss envelope is set so that the right hand side of Eq. ([4]) satisfies a violation probability of 

e = 10~ 3 . 

2. Deterministic trace envelope. This envelope is computed from a simulation of a packet trace with 1 mil- 
lion packets drawn from the given Pareto distribution. We compute the smallest envelope for the trace that 
satisfies Eq. ([!]) with e(a) = for all a > 0. The deterministic trace envelope, which is computed by 
Q(t) = sup T {A(t + t) — A(t)} j5j, provides the smallest envelope of a trace that is never violated. 

3. htss trace envelope. This is an htss envelope created from the same Pareto packet trace. We assume that 
the values of a and H = 1/a are given, but that the distribution is not known. The envelope is created 
directly from Eq. ([4]) by inspecting the relative frequency at which subintervals of the trace violate the htss 
envelope. First, K is selected as the smallest number that satisfies the right hand side of Eq. Q for all values 
of a. Then a is found by fixing the violation probability e = 10~ 3 . 

4. Average rate. For reference, we also include the average rate of the data in the figures, which is obtained 
from the same packet trace as in the trace envelopes. 

The resulting envelopes are plotted in Fig. [2] The discrete steps of the deterministic trace envelope 
around t = ms, t = 460 ms, and t = 680 ms are due to arrivals of very large packets at certain times in 
the simulated trace. The htss GCLT envelope is quite close to the data of the average rate. However, since 
the GCLT is an asymptotic result, this envelope is possibly too optimistic. On the other hand, the safely 
conservative htss trace envelope is much larger than the corresponding deterministic trace envelope. The 
reason is that the construction of this envelope performs a heavy-tailed extrapolation of the data trace, and 
thus amplifies the variability of the underlying trace. 

To investigate the variability of htss trace envelopes as a function of the length of the trace, we present 
envelopes obtained from subintervals of the trace used for Fig. [2] We use non-overlapping subintervals of 
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100,000 packets from the trace and compute htss trace envelopes for the subintervals. In Fig. [3] we show the 
envelopes normalized by the values of the htss GCLT envelope. We plot the maximum and the minimum 
values of the computed htss envelopes for the subintervals. The figure makes drastically clear that the range 
of values of the htss envelopes for the shorter intervals cover a wide range. This illustrates an inherent 
problem with generating a traffic characterization for heavy-tailed traffic from limited data sets. 

C. Measured Packet Traces 

We next show how to obtain an htss envelope from measured traffic traces. The trace data was collected in 
October 2005 at the 1 Gbps uplink of the Munich Scientific Network, a network with more than 50,000 hosts, 
to the German research backbone network. The complete trace contains more than 6 billion packets, col- 
lected over a 24-hour time period. Further details on the data trace and the collection methodology can be 
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found in [ 13]. From this data, we select the first 10 9 packets corresponding to 2.75 hours worth of data, with 
an overall average rate of r* = 465 Mbps. We refer to this data as the Munich trace. 

To extract the tail index and the Hurst parameter from the trace, we take advantage of parameter estimation 
methods for stable processes from j25j|^] which yields the following parameters for the Munich trace: 

a* = 1.98 , H* = 0.93 . 

The remaining parameter K needed for the htss envelope can now be obtained in the same way as described 
for the htss trace envelope. 

To provide a sense of the trace data, we present in Fig. [4] a normalized log-log plot of the Munich trace 

5 We use source code provided to us by the authors of |4|. 
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data in terms of the normalized random variable 

A(s,t) - r*(t - s) 



Y :-- 



(t-s 



Since Pr(Y > a) = Pr(A(s,t) > G(t—s; a)) where Q is giveninEq. ([5]), the distribution of Y corresponds 
to that of violations of the htss envelope. In the figure, we show the log-log plot of Y for different values of 
it — s), namely, t — s = 10, 100, 1000 ms. If the trace data was self-similar with the exact Hurst parameter 
H* , the log-log data curves should match perfectly for all values of (t — s). (We note that by reducing the 
value of the Hurst parameter slightly, the curves for different values of (t — s) can be made to match up 
almost perfectly). Since the decay of the log-log plots is obviously not linear, the distribution of the Munich 
trace does not appear to be heavy-tailed. We will see that a characterization of such a non-heavy-tailed 
process by an htss envelope leads to a pessimistic estimation. 

We can also use Fig. [4] to graphically construct an htss envelope for the Munich trace. Since we already 
have determined the tail index a* and the Hurst parameter H* as given above, we only need to find K. The 
value of this parameter can be obtained by taking the logarithm of Eq. ([4]). Using the definition of Y, this 
yields 

log Pr (y > a\ < log K — a* log a . 

Applying this relationship to Fig. |4| we should select K as the smallest value such that the linear function 
log K — a* log a lies above the log-log plots of Pr(Y > a) in the figure. In Fig. [4| we include the linear 
segment with K = 1225 as a thick line. Clearly, any other selection of K and a* providing an upper 
bound of the log-log plots of the Munich trace also yields a valid htss envelope for all values of a. An 
htss envelope for a fixed violation probability e can be obtained from Fig. [4] by finding the value of a 
that corresponds to the desired violation probability of the linear segment. Finally, we can use Fig. [4] to 
assess the accuracy of the htss envelope. The linear segment (the thick black line) is close to the trace data 
when Pr(Y > a) « 10 _1 . Otherwise, the linear segment is quite far apart from the plots of the trace. 
This indicates that the htss envelopes developed with the parameter settings used for the linear segment are 
accurate only when the violation probability is around 10 _1 . If the data trace was truly heavy-tailed, the 
data curves would maintain a linear rate of decline at a rate around a*, and would remain close to the linear 
segment for any a sufficiently large. 

In Fig. [5] we show htss envelopes for the Munich trace obtained with the linear segment from Fig. [4] for 
e = 10 _1 and e = 10~ 3 . For comparison, we include in Fig. [5] the average rate of the traffic trace, as 
well as a deterministic envelopes of the 1 sec subinterval of the trace that generates the most traffic. (Since 



the computation of a deterministic trace envelope as defined in Subsection II-B grows quadratically in the 
size of the trace, the computation time to construct a deterministic envelope for the complete Munich trace 
is prohibitive. The included deterministic envelope for a subinterval of the trace is a lower bound for the 
deterministic envelope of the complete trace. However, for the depicted time intervals, the deterministic 
envelope for the subinterval is a good representation of the deterministic envelope of the entire trace, for 
several reasons. First, by selection of the subinterval, at t = 1000 ms the envelope of the subinterval and 
the envelope of the complete trace are identical. Second, since any deterministic envelope is a subadditive 
function, the slope of the envelope decreases for larger values of time. Now, any function that satisfies these 
properties cannot vary significantly from the depicted envelope of the selected subinterval.) Comparing 
the htss envelopes with the reference curves confirms our earlier discussion on the accuracy of the htss 
envelopes: For e = lO -1 , the htss envelope is close to the plot of the average rate. On the other hand, the 
envelope for e = 10~ 3 is quite pessimistic, and lies well above the deterministic envelope. 
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III. Service Guarantees with Heavy Tails 

We next formulate service guarantees with a power-law decay. In the network calculus, service guarantees 
are expressed in terms of functions that express for a given arrival function a lower bound on the departures. 
In general, a statistical service curve is a function S(t; a) such that for all £ > and for all a > 

Pr(D(t) <A*S{t;a)) < e{a) . 

Here, 

A * S(t; a) = mi{A(s) + S(t - s; a)} 

s<t 

denotes the min-plus convolution of the arrivals with the service curve S(t; a), and e is a non-increasing 
function that satisfies e(a) — > as a — » oo. 

We define a heavy-tailed (ht) service curve as a service curve of the form 

S(t, a) = [Rt - a}+ , e{a) = La~ <i (15) 

for some j3 with < (3 < 2 and some constant L. In analogy to the formulation of traffic envelopes in 
Section [nj the ht service curve specifies that the deviation from the service rate guarantee R has a heavy- 
tailed decay. The rationale for not including a Hurst parameter in the definition of the ht service guarantees is 



that the form of Eq. ( 15 1 facilitates the computation of service bounds over multiple nodes. In this paper, we 
consider two types of ht service curves, one characterizing the available capacity at a link with cross-traffic, 
the other modeling a packetizer. 

• Service at link with cross traffic (Leftover Service): This service curve seeks to describe the service avail- 
able to a selected flow at a constant-rate link with capacity C, where the competing traffic at the link, 
referred as cross traffic, is given by an htss envelope. By considering the pessimistic case that the selected 
flow receives a lower priority than the cross traffic, we will obtain a lower bound for the service guarantees 
for most workconserving multiplexers (5|. Since the service guarantee of the selected flow consists of the 
capacity that is left unused by cross traffic, we refer to the service interpretation as leftover service. Since 
the derivation of an ht service curve for such a leftover service requires a sample path bound for the htss 
cross traffic, we defer the derivation to Subsection |I V-B | 

• Packetizer: We will also use the ht service model to express a packetized view of traffic with a heavy- 
tailed packet size distribution. We model discrete packet sizes by a service element that delays traffic until 
all bits belonging to the same packet have arrived, and then releases all bits of the packet at once. Such 
an element is referred to as a packetizer. By investigating packetized traffic we can relate our bounds to 
a queuing theoretic analysis with a packet-level interpretation of traffic (see Section [V]). We now derive a 
service curve for a packetizer. For a packet-size distribution satisfying Pr(X > cx} < La~ a , we show 
that a constant-rate workconserving link of capacity C provides an ht service curve with rate R = C and a 
suitable function e(a). 

Denote by X* (i) the part of the packet in transmission at time t that has already been transmitted. We can 
view X* (t) as the current lifetime of a renewal process. It is known from the theory of renewal processes 
(see pUJ, pp. 194) that 



lim Pr[X*(t) > a 



t^oo V w J E[X] 



Pr(X > x) dx 
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Fig. 6 

A NETWORK WITH CROSS TRAFFIC. 



The bound on the tail probability holds for all times t, provided that the arrival time of the first packet after 
the network is started with empty queues at t = is properly randomized. Using X*(t), the departures of a 
packetizer are given by 

A(t) , t_ = t, 

A{t) + C{t-t)-X*{t) , t<t, 

where t is the beginning of the busy period of t. Set S(t; a) = [Ct — a] + . If p is the utilization of A as a 
fraction of the link rate C, that is, 

E[A(s,t)\ 



D(t) 



s<t C(t - s) 



then 



Pr (p(t) <A*S{t;a)J < P Pr {X* (t) > a 



< P — . (16) 

-(a-l)E[X] K ' 

IV. Network Calculus with htss Envelopes 

We consider a network as in Fig. [6] A flow traverses nodes in series. Its traffic is referred to as through 
traffic. At each node, the through traffic is multiplexed with arrivals from competing flows, called cross 
traffic. Both through and cross traffic are described by htss envelopes. We will present results that yield 
bounds on the end-to-end delay and backlog of the through traffic. 

A. Statistical sample path Envelope 

The network calculus for heavy-tailed traffic is enabled by a statistical sample path envelope for traffic 
with htss envelopes. To motivate the relevance of the sample path bound, let us consider the backlog of a 
flow at a workconserving link that operates at a constant rate C. The backlog at time t is given by 

B{t) =sup{A(s,t) -C{t- s)} . 

s<t 

Notice that the backlog expression depends on the entire arrival sample path {A(s, t)} s<t . To compute an 
upper bound for the tail probability Pr(B(t) > a), in many places in the literature, in particular, in all 



prior works attempting a network calculus analysis with heavy-tailed traffic fl4j , |15|, [18|, [19], the tail 
distribution is approximated by 

Pr{B{t) > a) ss sup Pr(A(s,t)-C(t-s) > a) . 

s<t 
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However, the right hand side is generally smaller than the left hand side. Applying to the right hand side 
a statistical envelope that only satisfies Eq. ([T} but not Eq. ([2]) does not yield an upper bound but rather an 
upper bound to a lower bound. The derivation of rigorous upper bounds requires a sample path bound for 
the arrivals. To derive such bounds, we discretize time by setting x k = Tj k , where r > and 7 > 1 are 
constants that will be chosen below. If i — x k < s < t — Xk~i, then 

A(s, t) - C(t - s) < A(t - x k , t) - Cx fc _i . 

It follows that 

B(t) <sup{A(t-x k ,t) -Cx k -i) . 

k 

If the arrivals satisfy an htss envelope Q{t) = rt + at H with e(a) = Ka~ a , we obtain with the union bound 

00 

Pr(B(t) >a) < Pr{A{t-x k ,t) > <r + Cz fc _i) 



-00 



00 



. (0/7— Q-ttg 1 



^ HYi Ini / Kx ~ a ~ ldx 

~ H) log 7 J z ^ H{1 _ H) 

< Ka~ a{1 ~ H) . (17) 

In the second line we have used Lemma [6] from the appendix to evaluate the sum. Writing C = r + fj, and 
minimizing over 7 gives the constant 

K = K- inf \(^Ji- r ) —L 1. (18) 

i<7<i+^ l -V 7 / aH(l - iJ)log7J 

We remark that, typically, we have 1 < a < 2 and a -1 < iJ < 1, so that a(l — H) < 1. This means that 
the backlog is almost surely finite, but cannot be expected to have finite mean. 

The main technical ingredient of the above proof of the backlog bound is the discretization of time by the 
geometric sequence x k = 7 fc r. This is an instance of under-sampling, where not every time step is used 
in probabilistic estimates. Commonly in the literature, time is discretized by dividing it into equal units 
with x k = kr. In [33], the choice is described as a general optimization problem over arbitrary sequences 
< x\ < . . . < t, but not applied, since all examples in [33| only optimize over r in uniformly spaced 



sequences. Note that using a uniform discretization in the derivation of Eq. ( 17 1 would cause the infinite 
sum to become unbounded. 

An immediate consequence of the backlog bound is a sample path bound for htss envelopes. 

Lemma 1: ht SAMPLE PATH Envelope. If arrivals to a flow are bounded by an htss envelope 

G(t;a) = rt + at H , e(o) = Ka~ a , 

then, for every choice of \i > 0, 

g(t;a) = (r + fi)t + a, e{a) = Ka^ 1 -^, 



is a statistical sample path envelope according to Eq. (|2j). The constant K is given by Eq. ( 18 ). 

The proof follows immediately from Eq. ( [TT] ) by replacing C with the relaxed arrival rate r + //. The ht 
sample path envelope is reminiscent of a leaky-bucket constraint with a single burst and rate, and does not 
reflect the self-similar scaling of the htss envelope. 
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We note that a small modification of the proof would yield a sample path envelope of the form 

G(t,cr) = (r + n)t + at H + M, e{a) = La~ a , 

which retains the self-similar scaling properties of the htss envelope. The constant L depends on the param- 
eters a, H, r, /i and on the choice of M > 0. The reason we prefer the simpler envelope given by Lemma [T] 
is that it facilitates the estimation of the service provided to a flow across multiple nodes. 

B. Heavy-Tailed Leftover Service Curve 

cross traffic 



through traffic 

















A 




► 

D 



capacity C 



Fig. 7 

Constant-rate link with capacity C. 



With a sample path envelope for heavy-tailed traffic at hand, we can now derive a service curve for 
the heavy-tailed leftover service from Section [In] at a constant-rate link with capacity C, as illustrated 
in Fig. [7] We denote arrivals of the through flow by A and cross traffic arrivals by A c . Departures are 
denoted by D and D c , respectively. Assuming that A c is characterized by an htss envelope of the form 
G c (t) = r c (t — s) + a(t — s) Hc with e(a) = K c a~ ac where the bound on the arrival rate satisfies r c < C, we 
will show that the through flow is guaranteed a ht service curve <S(i; a) = [Rt— a] + with rate R = C— r c — \i, 
and a violation probability e(a) that can be estimated explicitly. Here, \i is a free parameter. 

Let t be the beginning of the busy period of t at the link. Then, the aggregate departures in [t, t) satisfy 
(D + D c )(t, t) = C(t — t), and departures for the cross traffic satisfy D c (t, t) < mm{C(t — t),A c (t) — 
A c (t)}. With this we can derive 

D(t) > A(t)+[C(t-t)-A c (t,t)] + 

> inf {A(s) + (C - r c - n)(t- s)\ - sup{,4 c (s, t) - (r c + n)(t- *)} , 

s<* s <t 

for every choice of \i > 0. We obtain 

Pr(D{t) < A*S(t;a)) < Pr(sup{A c (s, t) - (r c + fi)(t - s)} > a) 

8<t 

< K c a- ac{1 ~ Hc) , (19) 



where K c is given by Eq. ( 18 1 This proves that S(t;a) = [Rt — a] + is an ht service curve. 



The description of the leftover service in Eq. ( [19] ) can be combined with Eq. (16 1 to characterize the 
leftover service available to a packetized through flow at a node. The result (which we state without proof) 
is that at a link that operates at rate C > r c , the through flow receives a service guarantee given by the ht 
service curve 

S(t;a) = [(C-r c -n)t-a]+, e{a) = La'^ , (20) 
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where = min{a p — 1, a c (l — H c )}, a p is the tail decay in Eq. ( 16 1, and fi > is a free parameter. The 
violation probability is given by 

e(a)= inf_ [k^^ + ^ 



where p < 1 is the utilization of the through traffic as a fraction of C, E[X] is the average packet size, and 
the constant K c is defined by Eq. ( 1 8 1 with K c in place of K . When traffic is not packetized, the second 
term in the sum above is equal to zero. The constant in Eq. (20 1 can be computed explicitly by first using 
Lemma[5](Eq. ( |42) )) to lower the larger exponent to /?, and then applying Lemma[5](Eq. (|45|)). 

C. Single Node Delay Analysis 

We next present a delay bound at a single node where arrivals are described by htss envelopes and service 
is described by an ht service curve. 

Theorem 1: Single NODE Delay BOUND. Consider a flow that is characterized by an htss envelope 
with Q(t, a) = rt + a(t — s) and e(a) = Ka~ a , and that receives an ht service curve at a node given by 
S(t; a) = [Rt — a] + and e(a) = La' 13 . If r < R, then the delay W satisfies 

Pr(W{t)>w) < Af(iVT min{a(1 ~ H),/3} , 
where M is a constant that depends on a, H, r, \i = R — r, and 0. 

PROOF. Let A(t) and D(t) denote the arrival and departures of the (tagged) flow at the node. The delay is 
given by 

W{t) = ia£{t - s | A(s) < D(t)} . 
Fix (7i, o"2 > with R(o~\ + a 2) = w. Suppose that on a particular sample path, 

sup {^4(s, t — w) — R(t — s — w)} < o"i , 

s<t— w 



and that 



D(t) > M{A(s) + [R(t - s) - o 2 ] + } ■ 



If the infimum is assumed for some s < t — w, then 

D(t) > A(s) + R(t -s)-a 2 
> A(t - w) . 

If, on the other hand, the infimum is assumed for some s >t — w, then 

D(t) > A(s) > A(t - w) 
by monotonicity. In both cases, we see that W(t) < w. It follows with union bound that 

Pr(W(t) > w) < Pr( sup {A(s, t - w) - R(t - s - w)} > ai) 

s<t—w 

+ Pr(D{t) < mt[A(s) + R(t - s) - a 2 }+) 
< Ka- a{1 - H) + La^ , (21) 
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where K is defined by Eq. ( 18 1. For the first term, we have used the sample path bound in Lemma [I] with 
fi = R — r, and for the second term we have used the definition of ht service curves. The proof is completed 
by first lowering the larger of the two exponents to = min{a(l — H),j3} using Lemma[5](Eq. ([42])), and 
then minimizing explicitly over the choice of o\ and 02 using Lemma [5] (Eq. (45 1). For the constant, this 
yields the estimate 

( 0' 2^11+3' 

M < IK W«»M + Li 1+/3 )0 I . (22) 

□ 

Example: We compute the delay experienced by a Pareto traffic source at a 100 Mbps link. The parameters 
are 

a = 1.6, b = 150 Byte, A = 75 Mbps. 
With these values, the average data unit has a size of 400 Byte, and the link utilization is 75%. The service 



curve is computed from Eq. ( 16 1. The reason for selecting this example (which does not have cross traffic) 
is that it permits a comparison with a queueing theoretic result in [8 ], which presents a lower bound on the 
quantiles of a Pareto source in a tandem network with N nodes and no cross traffic, wn(z), as 

w N (z) > { -^t^ — . (23) 

((a-l)A- 1 |log(l-e)|)- 1 

In Fig. [8] we show a log-log plot of the delay distribution. The graph illustrates the power-law decay for 
the upper bound and the lower bound from [8]. We also show the results of four simulation runs of an 
initially empty system with 10 6 , 10 7 , 10 s and 10 9 packets. The simulation traces indicate that the actual 
delays may be closer to the lower bounds. Note that the fidelity of the simulations deteriorates at smaller 
violation probabilities. Since even long simulations runs do not contain sufficiently many events with large 
delays, they violate analytical lower bounds. Even the simulation run of 1 billion arrivals does not maintain 
the power-law decay for violation probabilities below e = 10~ 3 . 

D. Multi-Node Delay Analysis 

We turn to the computation of end-to-end delays for a complete network path. As in the deterministic 
version of the network calculus [51 we express the service given by all nodes on the path in terms of a single 
service curve, and then apply single-node delay bounds. We start with a network of two nodes. We denote 
by A\ the arrivals of the analyzed flow at the first node, and by D\ or A2 the departures of the first node that 
arrive to the second node. 

Lemma 2: CONCATENATION OF TWO ht SERVICE CURVES. Consider an arrival flow traversing two 
nodes in series. The first node offers an ht service curve with S±(t, a) = [R\t — ct]+ and e\(a) = L\a~^ , 
and the second node offers a service curve S2(t; a) = [i?2* — c] + and an arbitrary function £2(0")- Then for 
any 7 > 1, the two nodes offer the combined service curve given by 



r f ^2 1 

S(t,o~) = min|i?i, — jt — a 

e(a)= inf {i x {a x ) (| logmen)) + 2)2^- 1 ]+ + e 2 (<7 2 )) 
°"i +0-2=0- 1 J 

where i x {a) = min jl, ^^L^^ 1 }. 
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TWO NODES IN SERIES. 



The service rate R = min{i?i, -R2/7} in the expression for the service curve is the result of a min-plus 
convolution of the service curves at the individual nodes. The logarithmic term can be removed at the 
expense of lowering the exponent using Eq. (43 1 from Lemma|5] If the second node also offers an ht service 
curve, with £2(0") = £20"", then for every choice of (5 with (3 < (3% and (3 < [3 2 there exists a constant 
L = L(/3, R 2 ,~f) sucn that e(a) < La^ 13 . The value of the constant L can be computed from Lemma[5] 
(Eqs. d42]> and d45]>). 



PROOF. We proceed by inserting the service guarantee for Di = A2 at the first node into the service 
guarantee at the second node. Similar to the backlog and delay bounds, this requires an estimate for an 
entire sample path of the service at the first node. 

Fix t > 0. We consider discretized time points t — i/k, where yo = and = r + "y'yk-i for some r > 
and 7' > 1 to be chosen below. For t — < s < t — yk-i, we have 



A 2 (s) + [R 2 (t - s) - a], >A 2 (t- y k ) + [R 2 y k -i - a] 



+ ' 



and thus 



A 2 * S 2 {t; a) > inf {A 2 (t- y k ) + 

k>l 



R2 



#2 

a H r 



(24) 
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Set R = min ^ j and let 7' > 1 and 5 > be chosen so that ^ — 5 = R. Also fix <ti, <t 2 > and 
set a = o"i + <t 2 . If for a given sample path 



D 2 (*) > A 2 *5 2 (t;o- 2 ) 

and, for all > 1 with y k < t, 

Di(t - y k ) > A 1 *Si(t- y k ; o\ + Sy k 



R2 



(25) 



(26) 



then we can insert the lower bound for D\ = A2 from Eq. (26 1 into Eq. (24). After collecting terms, the 
result is D 2 (t) > A\ * S{t\ a). 

The violation probability of Eq. (25) is given by e 2 (cr 2 ). Assume for the moment that a > y 2 ^- We 
estimate the violation probability of Eq. ( 26 1 by 

Pr (Eq. ( [26] ) fails for some k with y k < t) 

00 

< Li Pr(Di(t - y fc ) < ^1 * - y k ; ai + <5y fc - i? 2 r/ 7 ')) 
(y-l)(<7i-J2r)" 



< 



fc=i 
Li / I 



log 7' V/3: 



+ 



log- 



<5r 



(<ti - Rr)-" 1 



In the first step, we have used the union bound and the ht service curve S\. In the second step, we have 
used Lemma [7] to evaluate the sum (with 7' in place of 7, and a = 5), and recalled that i? 2 /7 ; — 5 = R. 

(Here, we have used the assumption on a given before the equation). We eliminate the shift with LemmaB] 

1 

(Eq. (44 1), and insert the optimal choice r = R~ l ( ^ ^ , J ^ . Taking 7' = ^7 and S = R{^' — 1), we 



arrive at 



Pr 



Eq. ( 26 1 fails for 
some k with y k < t 

9inax{l,^ } 

Pi log 7 



< Zi^jlog^KT^ 1 ) +2) < El((7l)(|l0gei(ffl)| + 2) , 



L\. This bound remains valid for a < -p^j = Rt, since then we have £i(a) = 1. 



where L\ 

Applying the union bound to the violation probabilities in Eqs. ( [23] ) and (26) gives the claim of the lemma. 

□ 

Iterating the lemma results in the following end-to-end service guarantee, referred to as network service 
curve. To keep the statement of the theorem simple, we have assumed that each node offers an ht service 
guarantee with the same rate R, the same constant L, and the same power law j3. The general case can be 
reduced to this with the help of Lemma[5](Eqs. ( [42] ) and (45 )). 

Theorem 2: ht Network Service Curve. Consider an arrival flow traversing N nodes in series, and 
assume that the service at each node n = 1, . . . , N satisfies an ht service curve 

S n (t, a) = [Rt - a] + , e(a) = La' 13 . 

Then, for every choice of 7 > 1, the network provides the service guarantee 

Snet{t,a) = [(R/j)t-a] + , 

enet(a) < N 2 +? ■ 2^ 1 1+ • e(a) (| loge(a)| + (! + /?) logiV + 2) , 
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where e(a) = min jl, 2 J^ } La 



PROOF. We use Lemma|2]to recursively estimate the service offered by the last n nodes with n = 2, . . . , N. 
In each step, we reduce the service rate by a factor in place of 7. Fix a, and set a n = a/N for 

n = 1, . . . N. If e(a/N) > 1, there is nothing to show. Otherwise, we obtain 

JV 

Pr{D N (t) < A x * S net {t;o)) < £ Ne&)(\ log(Ni&)\ + 2) , 

n=l 

and the claim follows by collecting the factors of N. □ 

Example: We perform a multi-node delay analysis for a sequence of homogeneous nodes with the same 
parameters used for Fig. [81 The reason for using this example, is that it permits us to draw a comparison with 



the lower bound for multi-node networks from [8] given in Eq. (23 1. In Fig. 10 we show lower and upper 
bounds for networks with N = 1,2,4,8 nodes. For reference, we also include the results of individual 
simulation runs with 10 8 packets. The difference between lower and upper bounds is more pronounced than 
in the single-node analysis, and increases with the number of nodes N. For both lower and upper bounds, the 
straight lines make the power-law decay in w apparent. The growth of the bounds in N suggests a power-law 
growth in N, where the larger spacing for the upper bounds indicates a higher power. As before, we see that 
simulations violate analytical lower bounds. Since simulations of heavy-tailed traffic have little predictive 
values for larger delays, our analytical bounds provide more reliable estimates, even with the significant gap 
between upper and lower bounds. 

V. Scaling of Delay Bounds 

We now explore the scaling properties of the delay bounds from the previous section. Throughout this 
section, we consider a network as in Fig. [6] We assume that the network is homogeneous, in the sense 
that all nodes have the same capacity C, and all traffic is bounded by htss envelopes as in Eq. Q with the 
same power a and Hurst parameter H. The cross traffic at each node has rate r c and constant K c , and the 
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through flow has rate ro and constant Kq. Traffic can be either fluid-flow or packetized. In the latter case, 
the packet-size distribution of the through flow satisfies 

Pr{X > a) < L p a- a ? . 

We assume the stability condition ro + r c < C holds at each node. 

Single node, large delays (w — > oo). Our first result concerns the power-law decay of the delay distribution 
at a single node. We choose a relaxation of fi = i(C — r c — ro), and use the leftover service curve from 

S(t; a) = [{C - r c - fit - a)+ , e s {a) < L<t~? , (27) 



Eq. ( |20| ), given by 
where 



j3 = min{a p — 1, a(l — H)} , 



(28) 



and L is an explicitly computable constant. (For fluid-flow traffic, that is, without a packetizer, the first term 
does not appear, and we have (5 = a(l — H).) We then apply the delay bound of Theorem[T]with R = ro + /i 
to obtain 

Pr{W{t) >w)< MR^w' 13 . (29) 

The constant M is determined by Eq. ( 22 ) of Theorem [T] with /3' = (3. This shows that the delay decays 
with the same power law as the backlog bound in Eq. (fTTj). 



Multiple nodes, large delays (w — > oo). Now we consider scaling in networks with N > 1 nodes. We 



choose /x = §(C- 
We next choose 7 



c — ro). We obtain at each node the service curve in Eq. (27 1, with (5 given by Eq. (|28|. 
C r ~+^ and obtain from Theorem|2|the network service curve 



where R 



■net 



Snet{t',Cr) = [Rnett — Cr]_ 

ro + [i, and with violation probability bounded by 



enet{<?) < N 2 [logz]+ + 



P 



J J7W} 



with an explicitly computable constant L that does not depend on N. Combining the network service curve 
with the arrival envelope, we obtain from Eq. (21 ) of Theorem [T] for the end-to-end delay W ne t that 



Pr(W net (t) >w) < inf 



^Ka^ + £ net {a 2 )} ■ 



Here, the constant K is given by Eq. ( 18 1 with ro in place of r. We further choose u\ = N 
&2 = Rnetw — (X\, and see that 



-l- 



P Rnetw and 



Pr(W ne t(t) >w)< N 2+(i (Mi log w + M 2 log N + M 3 ) w 



The constants M\, M%, and M3 are again explicitly computable, and do not depend on N. The tail of the 
delay distribution, i.e., when w — » 00, is dominated by the first summand in the brackets, thus, we have the 
asymptotic upper bound 



Pr{W net {t) >w)= O(w-P]ogw) , ( w — > 00 



(30) 
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Multiple nodes, long paths (N —* oo). For long paths, i.e., N — * oo, the second summand dominates. 
The quantiles of the delay, defined by 



W ne t 



(e) = inf {w > | Pr(W net > w) < e} 



satisfy 



2+/3 



w ne t(e) = 0{N^ (log N)e), (JV-oo). 



(31) 



Comparison of scaling bounds. We next compare these upper bounds with scaling results from the 
literature for a Pareto service time distribution and no cross traffic, where traffic arrives in the form of 
evenly spaced packets Xi, with an i.i.d. Pareto packet-size distribution, as characterized in Section [IT] We 
assume that service times of packets are identical at each node in the sense of (6). By scaling the units of 
time and traffic, we may assume an average packet size of E[X] = 1 and a link rate C = 1, resulting in a 
rate A = p, where p is the utilization. 

For this model, it is known from queueing theory that the delay at a single node decays with a power law 
with exponent a — 1 (TTJ. Theorem 1 from fTTJ yields for the queueing time of the k-th packet in the steady 
state Q = lim^oo Qk that 



Pr[Q > a 



p Q-i) 

1-p 



a-l 



-a 



-(a-l) 



oo) . 



The delay of the kth packet is the sum of its queueing time and its processing time X^. This per-packet 
delay is related with the delay W(t) at a given time by 



W(t) = (Q m +X*{t))l B{t 



(i)>0 i 

where k(t) is the number of the packet being processed at time t, and X*(t) is the lifetime of the current 
packet, as defined in Section III Since packets are i.i.d., Wut) is independent of X*(t) and its distribution 
agrees with W^, and we can compute 



lim Pr(W(t) > w) 



1 



9 



-c{a)w 



-(a-l) 



oo 



(32) 



where c(a) is a constant that depends on the tail index. 



If we compare this asymptotic exact result with our bound from Eq. ( 29 1 andd30b, we see that (3 



a — 1, 

and so Eq. (|30b provides (up to a logarithmic correction) the same power-law decay as Eq. ([32]). The constant 
M in Eq. (29l is of order 0((1 — p)~ 2 ), while the right hand side of Eq. (32i is of order (1 — p)^ 1 , which 
indicates that our delay bound becomes pessimistic as p — > 1. 



Exploring the scaling in a tandem network, we first note that Eq. ( 17 1 states that for a single node, the tail 
probability of the delays decays with O (w~( a ~^ log w) . Since end-to-end delays exceed the delay at a sin- 
gle node, Eq. ( 32 1 guarantees that W(t) = Q, (w~( a ~^). Thus, our upper and lower bound differ by at most 

I 1 q+l 1 

a logarithmic factor. Eq. ( 3 1 1 implies furthermore that delay quantiles are bounded by O (N™- 1 (log N) J 
as N —>■ oo. From the lower bound from [8] given in Eq. p3j ) we can obtain that quantiles of the end-to-end 
delay grow at least as fast as w ne t(e) = f2(iVa^T). 

Lastly, we note that end-to-end delays are expected to grow more slowly if service times are independently 
regenerated at each node. A large buffer asymptotic from |3j for multi-node networks could be used to obtain 
the scaling properties of such a network. 
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VI. Conclusions 

We have presented an end-to-end analysis of networks with heavy-tailed and self-similar traffic. Working 
within the framework of the network calculus, we developed envelopes for heavy-tailed self-similar traffic 
and service curves for heavy-tailed service models. By presenting new sample path bounds for arrivals 
and service, we were able to derive non-asymptotic performance bounds on backlog and delay, as well as 
network-wide service characterizations. We explored the scaling behavior of the derived bounds and showed 
that, for single nodes, the tail probabilities of our delay bounds observe the same power-law decay as known 
results for G/G/l systems. We also described the scaling behavior of end-to-end delays. Our paper may 
motivate further study of the conditions under which performance bounds in a heavy-tailed regime can be 
tightened. A useful, possibly difficult extension is the derivation of a multi-node service curve that accounts 
for self-similarity, in addition to heavy-tails. 
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Appendix 



I. Self-Similar Traffic with Gaussian Tails 



While self-similar traffic is expected to be heavy tailed, some self-similar traffic types appearing in net- 
work analysis exhibit a faster decay. In the following we present a derivation of a network service curve 
for traffic with a Gaussian bound on the violation probability. More precisely, will consider processes that 
satisfy for all a > 

Pr(A(s, t) > r(t -s) + a(t - s) H ) < Ke' 1 ^ 1 ^ , (33) 



with some constants K > 0, a > 0, and a > 0. In terms of Eq. ([!]), this corresponds to a statistical envelope 

G(t; a) = rt + at H , e(a) = Ke'^^ 2 . (34) 



To motivate that envelopes given by Eq. (34 1 can provide useful traffic models, consider first the fractional 
Brownian motion (fBm) traffic model. In this model, arrivals are given by 



A(t) = rt + bt H N 0jl , (35) 

where iVo,i is the standard normal distribution, and b is a parameter that relates to the standard deviation. 
Eq. (35 1 is the special case of the a-stable process from Eq. (|6]> with a = 2. Using that the density of iVo,i 
is given by (f)(x) = —k=e~z x2 , we see from Eq. (35 I that 



(36) 



Pr(A(s, t) > r(t -s) + a(t - s) H j = J ^|= e "^ 2 dx < . 



i.e., Eq. (34) with K = 1/2 is a statistical envelope. 

An alternative description of arrival processes with Gaussian tails is through their effective bandwidth, 
defined by 

eb{6 1 t) = l t \o g E(e eA ^ 



The effective bandwidth of the self-similar process in Eq. (35 1 is given by eb(9, t) = p + ^b 2 9t 2H 1 . Let 
us consider more generally processes whose effective bandwidth satisfies the self-similar bound 



1 



eb(8,t) <p+-b z 9t 



2n,2H-l 



(37) 



By the Chernoff bound, Eq. ( 37 1 implies that 

Pr(A(s, t) > r(t -s)+ a(t - s) H ) < e -^ a ^ 2 , 



i.e., Eq. (34 1 with K = 1 is a statistical envelope. Note that for H > ^ and any given choice of 9, Eq. (37i 
does not define a linear bounded envelope process as defined in |[9j. 



25 



Lemma 3: SAMPLE PATH ENVELOPE FOR SELF-SIMILAR PROCESSES WITH GAUSSIAN TAIL. Assume 
that arrivals to a flow are bounded by a statistical envelope, given by 

g(t;u) = rt + at H , e{a) = Ke~^ a ^ 2 . (38) 
Then, for any choice of fi > 0, a statistical sample path envelope for the arrival process is given by 

g(t; a) = (r + fj,)t + a, e(a) = Le~ W , 
i 

with parameters /3 = 2(1 - H), c = 1 ~ B , and L = e ■ max {l, 4 H if r ^ ( +_ 2 "^ }. 

Proof. Fix fi > 0, let 1 < 7 < 1 + ^, and set b = ^ - r > 0. As done for the backlog bound from 
Eq. §Tfy , we argue that 

Pr ( sup {A(s,t)-g(t-s;a)}>0) < £ e (^|^) 

— fc=— CO 

< 1 r^cfc (39) 

- H{l-H) log 7 7 2 x 

< ^ z-V! 22 

" i?(l-ff)log7 

where z = ^g^g) ■ Here, the first inequality follows by discretization. In the second step, we have used 
Lemma[6]and replaced the integration variable x with x/b. In the third step, we have evaluated the integral. 

We want to replace the variable z by y = fi H o 1 ~ H /b, so that ^y 2 = (a/c) 13 . Suppose for the moment that 
y 2 > 2, and choose 7 such that log7 = (r//x + 2 — H)~ 1 y~ 2 . Then 7 < 1 + r//j,, as required. Moreover, 

z 2 = y 2 (^) 2H >y 2 (i- (r/A. + 2 - # ) log 7)^ > \y 2 , 

and 

z 2 >y 2 (l- 2(r/ A t + 2-fl')log7) > y 2 - 2 , 

and we obtain the bound 

-{ajcf 



Pr(sup{A(s,t) -g(t-s;a)} > 0) < Le~ {a 



This proves the claim for y > 2. On the other hand, for y < 2, the claim holds trivially since the right 
hand side exceeds 1. □ 



As in Section IV-B the sample path envelope immediately yields a leftover service curve. If fluid-flow 
traffic arrives to a link of constant rate C, where it is subject to cross traffic that has a statistical envelope 
with Gaussian tails, as in Eq. ([34]), then for every choice of fi > 0, 



S(t ] a) = [{C-r c - t i)t-a]+, e{a) = Le'W (40) 

provides a statistical service curve for the through flow with a Weibullian bound on the violation probability. 
Here, the parameters 0, c, and L are given by Lemma [3] Next, we show how to concatenate such service 
curves: 
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Lemma 4: CONCATENATION OF Weibull-tailed SERVICE CURVES. Consider two consecutive 
nodes on the path of a flow through a network. Assume that the first node offers a statistical service curve 
Si(t; a) = [R±t — cr] + with £i(cr) = Lie - ^ 01 ^ , and the second node offers a statistical service curve 
S%(t; a) = [R 2 t — o] + with an arbitrary function £2(0")- Then, for every choice of 7 > 1, the two nodes 
offer the combined service curve given by 

S(t;o) = [mm{R l7 R 2 /j} - o] + , 

e{cj) = inf \L ie -^ c ^ Bl + e 2 (o 2 )\ , 

where L x = maxje 2 , _^_ ( 2e ) 1 ^ 1+ Li|. 

PROOF. We follow the proof of Lemma|2] with the Weibullian function e\ (a) = L\e~^° r / Cl ) /31 in place of 
the power law. Set R = min{i?i, #2/7}, 5 = R 2 — R, and consider the event 

Di(t - y k ) >A x *S x (t- y k ; °\ + Sy k - R 2 t) , (41) 

where y k is a sequence of discretization time steps. We argue as in the proof of Lemma|2]that 5 is a service 
curve, with violation probability given by 

e(a) < inf {Pr (Eq. d4Tb fails for some k with y k < t) + e 2 (a 2 ) } . 

0"l+(T2=fT 

We could now use Lemma |7]to bound the violation probability of Eq. (41 1. However, since ei(cri) is an 
integrable function, we can obtain a slightly stronger bound by using the arithmetic sequence y k = kr, as 
in |T0[. The resulting estimate is 

00 

Pr (Eq. ( |4T| ) fails for some k with y k < t) < e\ (a\ + 5y k — R2T) 



k=l 



>3C 



< — / e\(x)dx 

OT J ai _ R2T 



Pi or 



rr 1 -R 2 T 
c l 



We have first used the union bound and the ht service curve, then replaced the sum by an integral, and 

c 0i 

finally evaluated the integral. Suppose for the moment that (di/ci) 1 > 2. We choose r = 1 g— j and 

use that 

(ox - R 2 t) Pi > erf 1 - max{l, P}R 2 to^ 1 ' 1 , < 2 

0\ — T 

to obtain 

Pr (Eq. (|4T) fails for some k with y k < t) < Zie" (<Jl/ci)/31 . 

But this inequality clearly also holds for (eri/ci)^ 1 < 2. The lemma follows by combining this with the 
service guarantee at the second node. □ 
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With this result, we finally present a network service curve that concatenates an arbitrary number of 
Weibullian service curves. 

Theorem 3: Weibullian NETWORK Service CURVE. Consider an arrival flow traversing N nodes 
in series, and assume that the service at each node n = 1, . . . , N satisfies a service curve 

S n (t,a) = [Rt - a]+ , e(a) = Le~^ P . 
Then, for every choice of 7 > 1, the network provides the service curve 

Snet{t,a) = [{Rh)t-a] + , 

where L = max < ^ log 7, - — — L >. 

PROOF. See the proof of Theorem[2] We use Lemma|4]to iteratively derive the service guarantee for the last 
n nodes. In each step, we reduce the rate by a factor of jn-i . To simplify the formula, we have replaced 
N — 1 with N whenever it appeared convenient, and used that <J£- < \ N < 1 + r^—. □ 

Consider now a network as in Figure [6] where all flows have envelopes with a Gaussian tail, given by 
Eq. (33 1. Assume that the network is homogeneous, i.e., all nodes have the same link rate, and the cross 
traffic has the same parameters at each node. Combining the results from this section, we obtain, similarly 
to the analysis in Section |V| the end-to-end delay bound 

Pr{W net (t) >w) = 0{N 2 e~ {j ^o )fi ) , {w -»• 00) , 

where M and u>o are constants that do not depend on N, and j3 = 2(1 — H). It follows that, over long paths, 
the quantiles of the delays scale as 

w net {e) = 0(N (log iV) 1//3 ), (#-00). 



For (3 = 1, this bounds recovers the 0(N log N) bound for exponential traffic from [ 10 1. 
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II. Technical Lemmas 

In our derivations, we frequently use properties of the function e(a) = Ka~ a that appears in the defi- 
nition of the htss envelope. The properties are summarized in the following lemma, and presented without 
proof. 



Lemma 5: 

1. (Lower power. ) We can lower the power by using that for Ka~ a < 1 and a' < a 

Ka' a <K^a- a '. (42) 

2. ( Eliminate logarithmic factor. ) For < (3, 

'^'±4jkw?~'- <43) 

3. (Remove shift.) For a > 0, oq > 0, and K(a — ao)~ a < 1, we can remove a negative shift by 

K{a-a y a < 2^ a -^+(K + a^)a' a . (44) 

4. (Minimize sum.) We can minimize sums of such functions by 

J— \ l+a 



mm 

01 H — ho- n =CT - 

i=i i=i 



^KjaJ a = a <r- a <n a K*- a , (45) 

where K = Uk x + K 2 + ... + tf n ) 



The following derives auxiliary estimates for two sums that involve geometric sequences. 

Lemma 6: Assume that e(x) is a nonincreasing nonnegative function. Fix 7 > 1 and r > 0, and set 
Xk = Tj k . Then, for every a > and every c > 0,, 

' a + cx k \ 1 f 00 e(x) 

— ax 



\ - / o- + cx fc \ 1 r 

V af J ~ H(l-H)log 7 J z 



k=— 00 



□ 

PROOF. Consider first the case where c = r = 1, i.e., Xk = 7 fe - Each summand in the series satisfies 

Since the first term on the right hand side increases with k while the second term decreases, we can bound 
the series by the sum of two integrals 

k=~oo V ' y J -°° JT 
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where the overlap between the intervals of integration compensates for the change of monotonicity. The 
optimal choice for the limit of integration is T = -H + j^, so that cr7"^ (T+1) = 7 ( 1 "^)*. In the first 
integral, the change of variables x = a^~ Ht yields 



/ e(aj- Ht ) dt = — / -^-dx, 

J-oo H\og^J z x 

where z = a 1_H r )~ H ^ 1 ~ H \ In the second integral, the change of variables x = ^ l ^ H '> t yields 

Adding the two integrals proves the claim for a = r = 1. For other values of c and r, we rescale a = 
ct x ~ h o, and apply the first case to the function e[x) = e(ct 1 ~ h x) . □ 



Lemma 7: Assume that e{x) is a nonincreasing nonnegative function. Fix r > and 7 > 1, and define 

7- 



recursively yo = 0, = t + jyk-i- Then, for every c > and cr > -^j-, 



f^e{a + cy k )<-^—(£{z)\og(^—^z)++f ^ dx 
fr[ log7 V V or / J z x 



z=a+CT 

PROOF. Consider first the case where c = 1 and r = 7 — 1, i.e., yk = 7 k — 1, and set z = cr + 7 — 1. For 
cr > 1, each summand is bounded by 



£ (°" + l k ~ l) < min + 7- l),e 



Since both terms are nonincreasing, we can bound the series by 

00 /-T /-oo 

Ve(cr + 7 fc -l) < / £ (a + 1 -l)dt+ etf) db . 

We choose T = ^ > 1, so that 7 T = cr + 7 — 1, and change variables x = 7* in the second integral 

to obtain 

1 ' r0 °e(x) , 
dx 



00 1 / /-C 



2=cr+7— 1 

This proves the claim in the special case a = 1 , r = 7 — 1 . For other values of c and r , we rescale cr = cr, 
z = ^jz, and apply the first case to e(x) = e (^Ejxj . □ 



